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(54) PICTURE CONTOUR EXTRACTING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To extract a precise contour by the reduced 
labor of an operator by generating a contour inside of a contour area along a 
contour area and correcting the position of the generated contour through 
the use of a picture being a processing object. 

SOLUTION: A circle of a prescribed diameter is displayed as a pointer at a 
previously fixed position such as the center of the screen. Next, a mouse 5 
is moved and moving information of the mouse 5 is sent to a display part 4 
and a contour area memory 7 as operation data 6. The memory 7 holds 
contour area picture data 8 of the same size as a picture data 1. This data 8 
is sent to a contour generation circuit 9, which generates the contour inside 
of the contour area along the contour area. The position of this contour is 
corrected to a right position while using the picture. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] An image storage means to memorize the image which is a processing object, and a display 
means to display on a screen the above-mentioned image and the pointer which consists of two or more 
pixels. The pointer migration means to which the above-mentioned pointer is moved in a screen by 
actuation of a user, Image profile line-extraction equipment characterized by having a profile field 
storage means to memorize the field through which the above-mentioned pointer passed as a profile 
field, a border-line generation means to generate a border line inside a profile field along the above- 
mentioned profile field, and a correction means to correct the location of the above-mentioned border 
line while using the above-mentioned image. 

[Claim 2] Image profile line-extraction equipment according to claim 1 characterized by correcting the 
location of the above-mentioned border line within the limits of the above-mentioned profile field in the 
above-mentioned correction means. 

[Claim 3] In the image profile line-extraction equipment which extracts the border line of a photographic 
subject by correcting the facies of a border line The image pick-up means of an image, an image storage 
means to memorize the image pick-up image, and a display means to display an image pick-up image on 
a screen. Image profile line-extraction equipment characterized by having the synthetic means which 
gives a synthetic indication of the mark to show the facies of the above-mentioned border line in the 
screen, and a correction means to correct the location of the above-mentioned border line while using 
the above-mentioned image pick-up image. 

[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image processing system which performs edit and 
processing of an image. 
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[0002] 

[Description of the Prior Art] A specific photographic subject is cut down along with a border line from 
the image displayed on the computer etc., and processing of compounding it to another background 
image is frequently made in various fields, such as a catalog and work of a poster or a web page. 
Although the operator has to input the border line by pulling a line using pointing means, such as a 
mouse, in that case, inputting the border line correctly according to the irregularity of the profile of an 
image requires time amount and an effort. 

[0003] Then, an operator inputting the facies of a border line, carrying out based on the border line, and 
correcting a border line to the edge part of an image automatically is often performed like reference 
"edge amendment of segmentation image using contraction block matching" Ida, triple cedars, and 
Watanabe (the Institute of Electronics, Information and Communication Engineers information system 
society convention lecture collected works, D 12-87, p1998 [ 309 or ]). In this case, if it is fixed within 
the limits even if gap of the border line to input is large, and it is small, the precision of the final result 
will not change so much. 
[0004] 

[Problem(s) to be Solved by the Invention] However, an operator will have misunderstanding with that to 
which the precision of the final result also becomes high, so that input precision is high, if possible, he is 
going to input a right border line, and will consume time amount great after all and an effort great after 
all. 

[0005] 

[Means for Solving the Problem] An image storage means to memorize the image which is a processing 
object in this invention, A display means to display on a screen the above-mentioned image and the 
pointer which consists of two or more pixels, The pointer migration means to which the above- 
mentioned pointer is moved in a screen by actuation of a user, It is characterized by consisting of a 
profile field storage means to memorize the field through which the above-mentioned pointer passed as 
a profile field, a border-line generation means to generate a border line inside a profile field along the 
above-mentioned profile field, and a correction means to correct the location of the above-mentioned 
border line while using the above-mentioned image. 
[0006] 

[Embodiment of the Invention] Thus, in what was constituted, the digital image which is a processing 
object is held at storage means, such as a hard disk and semiconductor memory, magneto-optical disk 
memory, and the image is displayed with the pointer which a pointing means directs on the screen of a 
personal computer or image edit equipment. According to these actuation, a pointer moves in the inside 
of a screen, using a mouse, a pen tablet, a touch panel, etc. as a pointing means. A pointer is displayed 
by two or more pixels, for example, a circle with a diameter of 1 6 pixels etc. 

[0007] And it moves so that a user may operate a pointing means and the profile of a photographic 
subject may be met in a pointer, but since the pointer has not a point but a certain magnitude at this 
time as mentioned above, it is impossible to double this with a profile exactly and to draw a border line. 
Therefore, the problem that a user will draw a border line carefully unnecessarily is not generated. 
[0008] And the field through which the pointer passed is held as a profile field, and a border line is 
automatically generated by thinning of the profile field as the center line of for example, a profile field, or 
a boundary line of the outside of a profile field, or the inside inside a profile field. 

[0009] And referring to image data, by the profile amendment processing shown in the reference "edge 
amendment of the segmentation image using contraction block matching" mentioned above, for example, 
a border line is corrected to a right location and is in agreement with the profile of a photographic 
subject. 

[0010] Hereafter, the example of this invention is explained using a drawing. Drawing 1 is the block 
diagram showing one example of this invention. 

[0011] Input maintenance of the image data 1 is beforehand carried out from the exterior in the image 
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memory 2. And if it is operated so that an operator may display the data, image data 3 will be read from 
an image memory 2, will be sent to a display 4, and will be displayed on a screen. The example of the 
displayed image is shown in drawing 3 (a). Moreover, it is displayed on the location which the circle of a 
predetermined diameter (for example, 16 pixels) sets [ center / of a screen ] to a screen beforehand as 
a pointer. If an operator moves a mouse 5, the mouse migration information will be sent to a display 4 
and the profile field memory 7 as actuation data 6. In a display 4, the location of a pointer moves 
according to the actuation data 6. Moreover, an operator's push of the carbon button attached to a 
mouse 5 sends the button-grabbing information to a display 4 and the profile field memory 7 as 
actuation data 6 too. In a display 4, while the carbon button of a mouse is pushed, in the display screen, 
the interior of the circle of a pointer is transposed to a predetermined color. If a mouse is moved along 
with the profile of a photographic subject by this while an operator pushes the carbon button of a mouse, 
a profile field will be displayed that a profile is included as shown in drawing 3 (b) and (c). 
[0012] The profile field memory 7 holds the profile field image data of the same size as image data 1. 
Profile field image data makes all pixel values zero beforehand. And when the information that the 
carbon button of a mouse is pushed with the actuation data 6 from the mouse 5 has been sent, the pixel 
value of the part which has the circle of a pointer in a display 4 is transposed to 1. It is generated as a 
binary image as the location of the profile field displayed on a display 4 showed by this to drawing 4 (a). 
The part of the pixel value 0 (white) expresses [ the part of the pixel value 1 (black) ] with this profile 
field image data except a profile field in a profile field. 

[0013] Thus, the generated profile field image data 8 is sent to the border-line generation circuit 9. In 
the border-line generation circuit 9. although the center line of a profile field is made into a border line 
therefore, the interior is smeared away black first. Next, in the one half of the diameter of a pointer, and 
this example, 8-pixel contraction (refer to a tree. Shimoda editorial-supervision "image-analysis 
handbook" University of Tokyo Press, the first edition, and 575 in 1991 - 576 pages) is performed. In 
this way. let the pixel of the outermost part of the made black field be a border line. Or thinning (577- 
578 pages of the same book) of a profile field may generate a border line. As for neither of the cases, 
into the part which is in contact with the edge of a screen, a profile field generates a border line like 
drawing 3 (c). Thus, the generated border line is amended by the right location by profile amendment 
processing mentioned above. The image data 10 sent from an image memory 2 is referred to in that 
case. The amended border-line data are outputted outside as output data 11. Or the alpha mask which 
smeared away the interior of the border-line data shown in drawing 5 (c) black is outputted as output 
data 1 1 . A foreground and the part of 0 express [ the part of the pixel value 1 ] a background with an 
alpha mask. 

[0014] In order to perform the profile line extraction described above, the example of the graphical user 
interface (GUI) displayed on the screen of a computer etc. is shown in drawing 2 . The image data 
chosen with the carbon button 19 which Screen 13 is located in the actuation window 12, and is opened 
here is displayed as an image of a processing object. If a pointer is moved on a screen after clicking the 
input pen carbon button 14 with the pointer of a mouse, it will change to a circular pointer. A profile field 
is drawn as mentioned above using this. When it has inputted accidentally, it will become rubber mode if 
the rubber carbon button 15 is clicked. In this mode, the border-line field of a part through which the 
pointer passed is canceled, and the original image is displayed. Moreover, when a pointer also passes 
[ the pixel value of the profile field image data in profile field memory ] the part of 1, it is returned to 0. 
The size setting edit box 16 inputs the diameter of a pointer, and the magnitude of a pointer is changed 
by rewriting this figure. The mark 17 which shows the magnitude of the occasional pointer is displayed 
next to the edit box 1 6. 

[0015] Drawing a profile field is finished and the profile amendment activation carbon button 18 is 
clicked in the place which changed into the condition of drawing 3 (c). Then, the generation and profile 
amendment of a border line which were mentioned above are performed, and the extract result of a 
border line is displayed on Screen 13. The display mode of an extract result is smeared away and 
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displayed in single predetermined colors, such as white, by making the outside of a border line into a 
background among images, as those with two kind and its one showed drawing 5 (a). Another display 
mode compounds a border line in an image by the predetermined color like drawing 5 (b). These should 
just choose the more legible one suitably by clicking the white background carbon button 20 or the 
profile carbon button 21. The subject-copy carbon button 22 is clicked to check the original image. To 
the change of these display images, using image data 3 and border-line data, suitably, a display image is 
generated and it displays on a display 4. If the exchange carbon button 23 of a foreground and a 
background replaces the foreground and background of an alpha mask which were mentioned above and 
clicks this, that whose thing whose pixel value was 1 till then was 0 0 will be transposed to 1. and a 
foreground and a background will interchange like drawing 6 R> 6 (b). 

[0016] A click of the carbon button 24 to return displays the border line before profile amendment is 
made. Thereby, the effectiveness of profile amendment can be checked. The whole screen carbon 
button 25 and the selection field carbon button 26 amend the whole border line, when the range which 
performs profile amendment is set up and the whole screen is chosen. However, even if it does not 
amend, a part of border line is the case where it is already in a right location etc.. and it clicks the 
selection field carbon button 26 to amend a part of border line, moves a pointer like drawing 6 (a) 
continuously, and sets a rectangle as a screen. If the activation carbon button 18 is clicked in this 
condition, amendment will be performed only inside rectangular and any border lines other than a 
rectangle will not be changed. 

[0017] The tool which corrects the extracted border line by manual operation, and is operated 
orthopedically is prepared for the correction tool carbon button 28. For example, if the rubber tool used 
at the time of the input of a profile field is used, the overflowing foreground region can be erased. 
However, when 1 pixel of profiles of an alpha mask shifts and they have, for example, overflowed the 
profile which wants to cut down an image, it is serious to move a pointer correctly in the precision of 1 
pixel. Then, using a thing called the tool to shave, as shown in drawing 7 R> 7 (a), it moves so that the 
border line which wants to shave a pointer may be gone by. This tool performs contraction processing 
mentioned above about the part which the pointer passed. If contraction width of face is made into 1 
pixel, only 1 pixel can be deleted finely. Contraction width of face may be made to be changed if needed. 
So to speak, this is an image deleted by the canna in woodwork. On the contrary, in dishing up only 1 
pixel of foregrounds, it is the same point as the case where it deletes, however performs expansion 
processing instead of contraction processing. According to these tools, since it is not necessary to 
centralize a nerve on migration actuation of a pointer so much, it is convenient. By making it go 
perpendicularly mostly to the border line which wants to crater the pointer which made the form of ** 
or ** others with the tool which was shown in drawing 7 (b). and to strike, the part is dented and the 
dividing enclosure is heaped up. Moreover, as shown in drawing 7 (c). a control point may be displayed 
on fixed spacing on a border line, and the tool which transforms a border line may be used by dragging 
this point and moving. When a certain control point is moved, a spline curve is generated using the 
control point near it, and it considers as the border line after correcting this. Correction will become 
easy if a control point is arranged with the priority to the point that a border line bends. 
[0018] When the preservation carbon button 27 is finally clicked, an alpha map is saved at the storage of 
a computer. 

[0019] In addition, the block diagram of another example which does not need manual actuation in the 
invention in this application is shown in drawing 8 . Input maintenance of the image data 102 picturized 
with the camera 101 is carried out in an image memory 103, and image data 104 is sent to coincidence 
at a display 105. On the other hand, graphic forms, such as an ellipse, are beforehand memorized by the 
profile field memory 106 as facies of a border line, and the facies data 107 of this border line are also 
sent to a display 105. In a display, as shown in drawing 9 , the facies 109 of the image pick-up image 108 
and a border line are compounded and displayed. 

[0020] Here, looking at a screen, a user adjusts the location of his own body, and the sense of a camera 
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so that the head of a part, for example, itself, to extract may meet the facies currently displayed. The 
facies data 111 are sent also to the border-line generation circuit 110, and are amended by the right 
location by border-line amendment processing mentioned above in the border-line generation circuit 1 10. 
The image data 112 sent from an image memory 103 is referred to in that case. The amended border- 
line data are outputted outside as output data 1 13. 

[0021] An example of an extract result is shown in drawing 10 . Thus, facies can perform also in an 
ellipse the extract which met the form of a hairstyle or a face by amendment processing by this 
invention. Moreover, since manual actuation is unnecessary, if this processing is repeated for every 
frame of a dynamic image, the automatic extract from an animation is possible. If the object coding 
mode of MPEG-4 is used as opposed to an extract image, transmission in a photographic subject unit 
will be attained in the TV phone in real time. 

[0022] The facies of a border line use a thing like drawing 1 1 , when extracting not only an ellipse but 
the upper half of the body. 

[0023] Moreover, if the body trace technique showed in Toshimitsu Kaneko and **** "the high-speed 
migration body pursue method for the hypermedia contents creation using robust presumption" (1 
Information Processing Society of Japan technical report CVIM1 13- 1998) be use, since locations, such 
as an ellipse, be correctable in a screen according to a motion of a face, there be a merit, like the time 
and effort to which a user adjust the location of a photographic subject and the sense of a camera can 
be save. 
[0024] 

[Effect of the Invention] As stated above, according to this invention, a border line with a high precision 
can be extracted by the effort with few operators. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram showing one example of this invention. 
[Drawing 2] Drawing showing one example of GUI by this invention. 
[Drawing 3] Drawing showing the input screen of a profile field. 
[Drawing 4] Drawing showing a profile field and a border line. 

[Drawing 5] Drawing showing an approach to change the method of presentation of a border line. 
[Drawing 6] Drawing showing a selection field, a foreground, and the background exchange approach. 
[Drawing 7] Drawing showing a correction tool. 

[Drawing 8] The block diagram showing another example of this invention. 
[Drawing 9] Drawing showing the example of a display of a synthetic image. 
[Drawing 10] Drawing showing an example of an extract result. 
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[Drawing 11] Drawing showing the example of a profile line-extraction pattern. 
[Description of Notations] 

1 Image Data 

2 Image Memory 

3 Image Data 

4 Display 

5 Mouse 

6 Actuation Data 

7 Profile Field Memory 

8 Profile Field Image Data 

9 Border-Line Generation Section 

10 Image Data 

1 1 Output Data 
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SO«^ ; E-Ftt2ii$i9, -^©—0^0 5 (a) K 
^b7t<tf»IC, H«©3 5TlMM8©n«*«*ibT 

fe^^tocgft-HUBs (b) (D^^^zmm 

^5rm^©feTB«lC^fiK-rSfe©T$.^). HtlfcttJl 

2 l ££7 ij .y^7-r-5^<i:TSS?Tn«<t^i. 7t©B«i£ 
iBUfeV^dl B«Jt5^>2 2€r^'J y^-T*. 
^n€)©*^Bife©^JO#AtC^bTtt, B#x-^3 
^Srffl^Tjgfi. **B^Sr^fi£bT** 
g|54(C*^-r5. iii«I©Af^^>2 3li M 

i$ b fcT ;w 7 7 -7 x £ ©sts t urn £ xns x. £ 1> © 
/tfc©teo tc, 0T$>-3fefc©(Ji i:lf«x.^n, 0 

6 (b) ©«fc3KM*£***«An»to*. 

[0 0 16] It*^>2 4Ji"Jyi'tl)i:, 

jEtf&3n*w©i&»ii#3i«sn*. rntcfco, is 

!E«IE©SaS£*IgT*#5. BB±«:^^>2 5 iSK 
«#5'>2 6ll (t»»iE*ffa:5IBH«:»3t"r* , b 
©T, !B®li:^* i a^^*iTV^«i:#tC«, $ilB^±^ 

»»«»**|]EbfcV»«^tCJ4aiR«*3l?^ > 2 6 5:^7 
'Jy^U ^ltT06 (a) ©<t5lw#-f >^*»*»b 

xim*mmzWL 4 fctz>. uco«itHff*^> 1 8 & 

[0 0 1 7] «IE > >'-^*5'>2 8tCtt. #Jtt5;*nfc$ft 

■&„ bA^b, ^JAtf. 7^7T^7.i7©^IB^B^©«] 
#-f>:?£ 1 B^©*IST-iE«ltC^l!j$-<i:5©{S^: 

7 (a) (I^bfcct^lC, >^«r»JDfcl»<l»aSr 

wtt\z^^Tfftftvtcwmmm&ftts.?b<»r'&z>. ir 
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5 

<T£rtr©T"ffi?iJT&5. ffilCfc, 07 (b) JC^b7c 

zittz^mnmzMVTmmmjjfaizftmzitzzt 

-5. 0 7 (c) \z-mVtz£o\z&%m±\z-fem 

ntf0EiErt»eiJK:fc4. 

[0 0 18] 2 7^i7'J-^t^i. 

7^777-; 7#f|-*«©ett «M* IC«# $ n% . 

[0 0 19] 7i^*®^^JC^^TV-j.7;Htff*j2> 

L&^BycuagegcDT'n ? ^ 0£0 8 tc^-r. * * 
5101 KioTittfian&B*^-^ i o 2nwm* 

tU 1 0 3fcA*«fc£n, HWrKHttk?*-* 10 4*i 
1 0 5 £3! -**SH$6I«;* ^ U l 0 6 

nTJso, twiMuw©*^-^ i o 7t>as«i o 
h# 108 tffin&<D&Lf& 109 ^^^nxtf^n 

-So 

[0 0 2 0] 'IT, HB5S.&fc:o«&, ttffi 

fc»3J:3lC, £#©#:©&M-^;fr*7©ft££18gn''f 
•5. *S^x-^l 1 ltt, $l*l5^^fiElHlSS 1 1 OtCfcBt 

en. t^iBH^fiKtHiss 1 1 otii aa&bfciftfBii&fluE 
u i o 3fr*>mt>nz>wm : T-? 1 1 2^i$n5. 

[0 0 2 1 ] glOt, «ffl<&*©-tfl*jR-r. coi 
■3fc, *»9Ik:«fc?K «Ug«t»RT'fc. fcHEMSKio 
TSS-^S©^{C»o7 v cffltiJ^T^-5. 7"i7 

;Hi«OTgft©T, ttiii*©:7U— A*fcc:©»3*: 



(4) 

fcUli^tC^LT0iJAtfMP EG-4©^-^vii7 hft^t- 

[0 0 2 2] IIJMft©ttJgttffiP]fCl6&-r, «Atf±¥ 
[0 0 2 3] *i£ rn;\'7. h«5££ffl 

tt#iitt&i («««a*^a*«flrc v i m 1 1 3 - 

10 1, 1 9 9 8) «C*£nfctt#ifitt*8fc£*m»*i 
tf. K©tt#fc£toirrHiBrtT«Hfc£©tt«fc0nE 
T#5©T', ««##*¥<*©««■*»*.* 5 ©GlSfcW 

[0 0 2 4] 
[BB©!B¥&tt9I] 

[Hi] *56W©-*M«**T^ny^H. 
20 [02] #fg9it;:£5GU I ©-£*«**-rB. 
[0 3] $feH5««©A^M®Sr*T0. 
[0 4] IMMtt&fftlHiewTH. 
[0 5] H«*©**#tt©«J0**.:£tt*3jVrH. 
[0 6] SKtUft^ttflt. «SA#x.;£i££*-f0. 
[0 7] UttEy— n^T^fS. 
[0 8] *^^©SiJ©^Jg««JSr^T> r P-y^0. 
[0 9] £fi£lB&©«*0iJ£^-1-0. 
[010] ttt±5i^m©-^JS:^T0. 

[011] t§B%mmmrt?->M*7*-rm. 

30 

1 H«x-* 

2 jS^^^EU 

3 Hfti^-:? 

4 a^gu 

5 -7^77. 

6 m*??-* 

? u 

8 fc8ifl$m«lli&^-* 

9 &$Bigi!±fi£gB 
40 10 Hit^— 

1 1 fflTJx-^ 



[01 0] 



[011] 
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